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Super Imposed Image Display Color Selectiog System and Method 
Field of the Invention 

5 

The current invention is generally related to color display devices and methods, 
and more particularly related to selecting a color to display image such as characters and 
diagrams over existing color image in display devices such as personal computers and 
personal digital assistants. 

10 

BACKGROUND OF THE INVENTION 

In order to improve operability, computer graphics utilizes separate colors for 
entries and background in an input screen as disclosed in Japanese Patent Publication Hei 

15 7-325666. Instead of using a mouse or a keyboard, an input pen or stylus is used to input 
information, and the input pen is also used with a computer in video conferencing. For 
example, a liquid chrystal display device as disclosed in Japanese Patent Publication Hei 9- 
1 14591 recognizes coordinates of an input pen position when the input pen is placed on the 
liquid chrystal display unit. Based upon these coordinates, as the input pen moves on the 

2 0 liquid chrystal display unit, a trace is displayed in a predetermined color. In the above 
display unit, the traces or lines are displayed over existing images by superimposing the 
lines. By using a large color display screen, the above display is highly useful for 
conferences, presentations or education. 

2 5 In the above described input pen system, the color of an input pen is 

predetermined prior to use. In certain instances, the selected pen color may be identical to 
or substantially similar to a background color of the display image. As a result of the 
above undesirable input color selection, the line traces of the input pen may not be easily 
discernible. In particular, when a large display unit is used for a presentation to a group of 

3 0 people and input pen traces are not easily identifiable from the existing image or 

background color, the display presentation system has a serious flaw. In other words, the 
need for specifying an input color substantially reduces the operability and convenience. 

1 
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For presentations using a large color display unit, when a group of people 
recognizes superimposed line traces in images, it is highly desirable for the line traces and 
other graphics to be easily recognized. Even when a small screen device or an individual 
5 document generating device such as a PC is used to prepare the presentation material, the 
lines and images are easily discemible. However, the same data may not be easily 
discernible on a large screen without a sufficient amount of projection light. In these 
. document generation devices such as PC's, a user specifies the color of lines and characters 
to indicate emphasis, and an appropriate color with respect to the background color is not 
10 automatically selected. 

In a different application of the line trace, a karaoke machine generally indicates 
words in a predetermined color that is easy to read against the background. However, the 
color of words may sometimes becomes substantially similar to that of the still or animated 
background, and it becomes difficult to read the words. 

15 

In general, a complementary color is used to distinguish a display color or a pen 
color from a background color. The complementary color is a color that generates gray 
when it is mixed with the background color. However, a simple complementary color is 
not necessarily the most readily visible to all people. In fact, a certain color combination is 
2 0 not always pleasing to many, and may be unsuitable in some business situations. For 
example, the background color and the pen color are respectively green and pink for the 
complementary color combination. The color pink may not be appropriate in conservation 
presentation material. 

The above described problems demand a method and a device for automatically 

2 5 selecting a desirable input pen color with respect to a background color to maximize the 

visibility of input images. 

SUMMARY OF THE INVENTION 

3 0 In order to solve the above and other problems, according to a first aspect of the 

current invention, a method of selecting an optimal color with respect to a background 
color using Munsell color-order system, the Munsell color-order system being represented 
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in a three dimensional space around an achromatic axis in a vertical direction, the vertical 
direction representing a predetermined lightness range of lightness levels, a horizontal 
direction representing a predetermined saturation range of saturation levels, a 
circumference around the achromatic axis representing a predetermined hue range of hue 
5 levels, including: electing a first point in the Munsell color-order system as a first color; 
electing a second point in the Munsell color-order system as a second color at a 
predetermined relative distance fi-om the first point, the first point and the second point 
forming a relative distance line, the second color being sufficiently distinctive in 
combination with the first color for desired human perception; and determining an optimal 
1 0 color range of colors fi-om the second point in the Munsell color-order system, the second 
color being selected fi:'om the optimal color range. 

According to a second aspect of the current invention, a memory medium storing 
J2 a computer executable program for selecting an optimal color with respect to a background 

15 color using Munsell color-order system, the Munsell color-order system being represented 
4S in a three dimensional space around an achromatic axis in a vertical direction, the vertical 

J"" direction representing a predetermined lightness range of lightness levels, a horizontal 

C3 direction representing a predetermined saturation range of saturation levels, a 

{;! circumference around the achromatic axis representing a predetermined hue range of hue 

2 0 levels, the executable program including the steps of: selecting a first point in the Munsell 
color-order system as a first color; selecting a second point in the Munsell color-order 
system as a second color at a predetermined relative distance firom the first point, the first 
point and the second point forming a relative distance line, the second color being 
sufficiently distinctive in combination with the first color for desired human perception; 

2 5 and determining an optimal color range of colors firom the second point in the Munsell 

color-order system, the second color being selected fi*om the optimal color range. 

According to a third aspect of the current invention, a system for selecting an 
optimal color with respect to a background color using Munsell color-order system, 

3 0 including: a memory storage unit for storing data for representing the Munsell color-order 

system, the Munsell color-order system being represented in a three dimensional space 
around an achromatic axis in a vertical direction, the vertical direction representing a 
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predetermined lightness range of lightness levels, a horizontal direction representing a 
predetermined saturation range of saturation levels, a circumference around the achromatic 
axis representing a predetermined hue range of hue levels; a processing unit connected to 
the memory storage unit for selecting a first point as a first color and a second point in the 
5 Munsell color-order system as a second color at a predetermined relative distance from the 
first point, the first point and the second point forming a relative, distance line, the second 
color being sufficiently distinctive in combination with the first color for desired human 
perception, the processing unit also determining an optimal color range of colors fi-om the 
second point in the Munsell color-order system, the second color being selected fi-om the 
10 optimal color range; and a display unit connected to the processing unit for displaying the 
second color against the first color. 

These and various other advantages and features of novelty which characterize the 
invention are pointed out with particularity in the claims annexed hereto and forming'a part 
15 hereof. However, for a better understanding of the invention, its advantages, and the 

objects obtained by its use, reference should be made to the drawings which form a further 
part hereof, and to the accompanying descriptive matter, in which there is illustrated and 
described a preferred embodiment of the invention. 

20 BRIEF DESCRIPTION OF THE DRAWINGS 

FIGURE 1 is a diagram illustrating one preferred embodiment of the color 
selection display unit according to the current invention. 

2 5 FIGURE 2 is a diagram illustrating a computer that includes a memory so that a 

computer program is executed. 

FIGURE 3 is a diagram illustrating the display controller according to the current 
invention. 

30 

FIGURE 4 is a flow chart illustrating the steps involved in one preferred process 
of the display control according to the current invention. 
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FIGURE 5 is a diagram illustrating icons in the presentation material generation 
window on the display unit. 

5 FIGURE 6 shows lightness, saturation and hue in a three dimension 

representation. 

FIGURE 7 illustrates sections of the Munsell color-order system that are sliced 
perpendicularly to the achromatic axis. 

10 

FIGURE 8 is a diagram illustrating a method of selecting a font color based upon 
p the background color according to the current invention. 

FIGURE 9 shows that the center of the Munsell color-order system representation 
1^ 15 is used as an origin in the three dimensional coordinate. 

5 FIGURE 10 is a flow chart illustrating the steps involved in a preferred process of 

l": determining the font color according to the current invention. 

'iZ, 2 0 FIGURE 1 1 is a diagram illustrating a second preferred embodiment of the color 

M font display optimization system according to the current inventions. 

> FIGURE 12 is a diagram illustrating a third preferred embodiment of the color 

display optimizing system according to the current invention. 

25 

FIGURE 13 is a diagram representing the lightness in ten stages. 

FIGURE 14 is a diagram illustrating a fourth preferred embodiment of the 
optimal image color selection system according to the current invention. 

30 

FIGURE 15 is another diagram illustrating the fourth preferred embodiment of 
the optimal image color selection system according to the current invention. 
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FIGURE 16 is a diagram illustrating a certain aspect of a fifth preferred 
embodiment of the optimal image color selection system according to the current 
invention. 

5 

FIGURE 17 is a flow chart illustrating steps involved in the fifth preferred 
embodiment of the optimal image color selection system according to the current 
invention. 

FIGURE 1 8 is a diagram illustrating a sixth preferred embodiment of the image 
color display selection according to the current invention. 

FIGURE 19 is a diagram illustrating one exemplary implementation of a color 
display device. 

FIGURE 20 is a flow chart illustrating steps involved in the sixth preferred 
embodiment of the optimal image color selection system according to the current 
invention. 

FIGURE 21 is a flow chart illustrating steps involved in a tenth preferred 
embodiment of the optimal image color selection system according to the current 
invention. 

FIGURE 22 is a chart indicates the evaluation of the pen display color that is 

2 5 automatically selected by the seventh preferred embodiment according to the current 

invention. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT(S) 

3 0 Referring now to the drawings, wherein like reference numerals designate 

corresponding structures throughout the views, and referring in particular to FIGURE 1 , 
one preferred embodiment of the color selection display unit according to the current 

6 
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invention is implemented on a personal computer (PC) for generating a document to be . 
presented at a conference. The PC 1 is connected to a display monitor 2, a keyboard 3 and 
a mouse 4. 

5 Now referring to FIUGRE 2, the PC 1 further includes a central processing unit 

CPU 10, a main memory unit 1 1, a clock unit 12, a bus controller 13, a Read Only Memory 
ROM 14, Peripheral Component Interconnect (PCI) Bridge 15, a cash memory unit 16, a 
hard disk 17, a hard disk controller 18, a display controller 19, a moving picture experts 
group decoder 20, a speaker 21 , a LAN controller 22, a LAN interface (I/F) 23, a floppy 

10 disk controller 24, a floppy disk drive 25, a digital video versatile disk random access 

memory (DVD-RAM) controller 26, a DVD-RAM drive 27, a keyboard controller 28, a 
mouse I/F 29, a real time clock (RTC) 30, a CPU bus 3 1, a PCI bus 32 and X bus 33. The 
CPU executes a control process program from the ROM 14 as v^ell as various application 
programs and an operating system program that are read into the main memory 1 1 from the 

15 hard disk 17. The main memory 1 1 fiirther includes a dynamic random access memory 
(DRAM) that is used as a work area. 

Still referring to FIUGRE 2, the PC 1 further includes the following components. 
The clock 12 fiirther includes a crystal oscillator and a frequency divider circuit and 

2 0 generates clock signals that control the CPU 10 and the bus controller 13. The bus 

controller 13 in tum controls the data transfer on the CPU bus 31 and the X bus 33. The 
ROM 14 stores control programs for a system start-up and various devices. The PCI bridge 
15 transfers data between the PCI bus 32 and the CPU 10 via the cash memory 16. The 
cash memory 16 is implemented by DRAM and is used by the PCI bridge 15. The hard 

2 5 disk 1 7 stores the system software, viarious application programs and user data. The HD 
controller 1 8 has an interface unit such as integrated device electronics (IDE) for the hard 
disk 17 and transfers data at a high speed. Furthermore, as will be explained later, the hard 
disk 17 also stores a table containing RGB data that correspond to the Munsell color-order 
system. 

30 

As will be described later in detail, a preferred embodiment utilizes the Mulssel 
color system and stores the mapping information for the RGB display in the hard disk 
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Storage 17. That is, the Mulssel color system specifies a color based upon a set of hue, 
lightness and saturation values, and the three dimensional coordinates in the Mulssel 
system correspond to the above set of the values. The three dimensional coordinates, set of 
hue, lightness and saturation values as well as the RGB display values are all stored in the 
5 1:1 corresponding manner in the hard disk storage 1 7. 

The display controller 19 converts character data and graphics data in a digital 
format to an analog format and exert controls on these data in order to display on a display 
screen 2a of the color display 2. The operation and the components of the display 

10 controller 19 will be later described. The MPEG decoder 20 decodes data in MPEG files 
that are stored in the hard disk 17 and DVD-RAM via DVD-RAM drive 27. The decoded 
YUV video data is in the ratio of Y:U:V=4:2:2. The MPEG decoder 20 outputs the 
decoded YUV video data to the display controller 19 while it converts the decoded audio 
data in a digital form to an analog form before outputting the analog audio signal to the 

15 speaker 21, In the decoded YUV video data, Y represents an intensity component while U 
and V represent chroma. U^B (blue)-Y, V=R (red)-Y, 

The LAN controller 22 is, for example, compatible with IEEE 802.3 
communication standard protocol (Institute of Electrical and Electronics Engineers) and 
2 0 controls communication to other devices connected to the Ethemet via LAN I/F l 23. The 
FD controller 24 transmits data to the FD drive 25. The interface between DVD-RAM 
controller 26 and DVD-RAM drive 27 is for example Small Computer System Interface-2 
(SCSI-2), and the data is transferred. The keyboard controller 28 connects serial data that is 
imputed via keyboard to parallel data. The mouse I/F 29 has a mouse port and is 

2 5 controlled by a mouse driver or a control program. RTC30 is a time date clock and is 

backed up a battery that is not shown. 

The display controller 19 is a major component of the color display control device. 
The operation and the components of the display controller 19 will be described below. 

3 0 Referring to FIGURE 3, the display controller 19 includes a graphics controller 40, a 

graphics video memory 41, a graphics data conversion unit 42, a display data generation 
unit 43, a digital-to-analog connecter (DAC) 44, a video coder 45, animation/graphics 
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video memory 46, a video data connector 47 and a video data superimposing unit 48. The 
graphics controller 40 maintains a plurality of display planes or user planes that the CPU 
has access. For example, a first plane is a background while a second plane is an image 
plane containing characters and graphics. These tv^o planes are maintained as separate user 
5 planes. The graphics controller 40 generates display data according to commands for font 
data or graphics from the CPU 10. For example, upon receiving a black fill command 
from the CPU 10, the graphics controller 40 generates data in a specified color for every 
pixel in a specified area. These data represent each pixel by red R, green G, blue B and 
intensity I, and a single bit represents each of the R, G, B and I. The graphics controller 
10 40 superimposes the user planes such as a background color, characters and lines. 

The graphic video memory 4 1 is a video random access memory (VRAM) and has 
separate R, G, B and 1 - bit planes. The graphics data conversion unit 42 reads 8 pixels or 
32 bits of data from the graphics video memory 42 and converts to 8-bit data/pixel using an 

15 intemal color pallet. The display data generation unit 43 reads one pixel on 8-bit data from 
the graphics data conversion unit 42. Based upon an intemal color look-up table, the 
display data generation unit 43 generates 6-bit data for each of R, G and B per pixel. When 
video data is displayed by superimposing on others, the above generated data is outputted 
to the video superimposing unit 48. Otherwise, the above generated data is outputted to 

2 0 the DAC 44. The DAC 44 converts each of the digital data R, G and B to analog image 
signals and outputs to the color display 2. 

The video decoder 45 converts to 8-bit data for each R, G and B for each pixel from 
the YUV video data from the MPEG decoder 20 or the YU V video data for a still image 

2 5 such as JPEG that is decompressed by software and the CPU 10. The animation/still video 

memory 46 is VRAM and includes the separate R, G and B planes. The video data 
conversion unit 47 converts 8-bit R, G and B data to 6-bit data based upon the intemal 
conversion table. The video data superimposing unit 48 superimposes the R, G and B data 
from the display data generation unit 43 over the video data from the video data conversion 

3 0 unit 47. Otherwise, the video superimposing unit 48 takes logical OR for each bit of the 

above data and outputs the result to the DAC 44. 
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The display controller 19 has the following operations depending upon a type of the 
data or superimposition of the data. In summary, the processing by the display controller 
19 is categorized into groups of A. characters or graphics without animation or still images, 
B. animation, C. still images and D. characters or graphics to be superimposed or 
5 animation or still images. For the group A characters or graphics without animation or still 
images, the processing flow includes from the PCI bus 32 via the graphics controller 40, 
the graphics video memory 41, the graphics data conversion unit 42, the display data 
generation until 43, the DAC 44 to the color display 2. For the group B. the animation 
data, the processing flow includes from the MPEG decoder 20, via the video decoder 45, 

10 the animation/still video memory 46, the video data conversion unit 47, the video data 

superimposing unit 48, the DAC 44, to the color display 2. For the group C. the still image 
data, the processing flow includes from the PCI bus 32, via the video decoder 45, the 
animation/still video memory 46, the video data superimposing unit 48, the DAC 44, to the 
color display 2. For the group D. the characters or graphics to be superimposed on 

15 animation or still image, the processing flow includes from the PCI bus 32, the graphics 
controller 40, the graphics video memory 41, the graphics data conversion unit 42, the 
display data generation unit 43, the video data superimposing unit 48, the DAC 44 to the 
color display 2. 

2 0 Referring to FIGURE 4, a flow chart illustrates the steps involved in one preferred 

process of the display control according to the current invention. To simplify an 
exemplary process, no animation nor still image is involved for the character or graphics 
display using the personal computer 1 and the CPU 10 in particular. In a step SI, it is 
determined whether or not a presentation material window is generated. This 

2 5 determination is to check if an application program for generating presentation material has 

started based on the user operation. At this time, as shown in FIGURE. 5 in the 
presentation material generation window on the display 2, icons such as a character icon 
49a for selecting a character color and a background color icon 49b for selecting a 
background color are displayed. If the presentation material generation window is 

3 0 generated, the CPU 10 displays a predetermined default background color in the display 2 

via the graphics controller 40 and the display controller 19 in a step S2. In the step S2, the 
CPU 10 identifies a point A in the Munsell color-order system for the above default 



10' 



RCOH-103 6/AP01-2 50 



PATENT 



5 



10 

i: 15 

K 20 



25 



30 



background color. At the same time, by referring to the 1 : 1 correspondence RGB- 
Munselle color system table that is stored in the hard disk 17, the Munselle color values are 
determine based upon the RGB data, and by the' Munselle color value — 31) coordinate 
table, the coordinates in the Munsell color-order system are determined for the point A. 
The CPU 10 performs the above described step S2 or functions as a device for the same. 

The CPU 10 determines a point B based upon the point A according to a 
predetermined calculation that will be described later. Based upon the point B, the 
character color or image color is determined for the background color and the character or 
the image is superimposed in the above determined color in a step S3. BY referring to the 
1:1 correspondence RGB-Munselle color system table, the three dimensional coordinates 
in the Munsell color-order system are converted to the RGB valves. The CPU 10 performs 
the above described step S3 or functions as a device for the same. Under the above 
conditions, it is determined in a step 84, whether or not any character input exists from.the 
keyboard 3. If the character input exists in the step S4, the CPU 10 outputs a command 
specifying the selected font color to the graphics controller 40 and displays the via the 
display controller 1 8 the characters in an easily perceived color with respect to the 
background color on the display screen 2a in a step S5. 

When there is no keyboard input in the step 84 but the background color is charged 
in a step 86 by selecting the background color icon 46b, similarly to the above described 
steps, the CPU 1 0 determines a character color based upon the point A for the altered 
background color in the Munsell color-order system in accordance with the predetermined 
calculation as described with respect to the step S3. The CPU 10 outputs a command 
specifying the selected font color to the graphics controller 40 and displays via the displays 
via the display controller 19 the characters in an easily perceived color with respect to the 
background color on the display screen 2a as in the step 85. As described above, even if 
the background color is charged, the characters are always seen in an easily perceived 
color. 

Referring to FIGURES 6 and 7, a preferred embodiment or process of determining 
an easily perceived character color as described in the step S3 according to the current 
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invention uses the Munsell color-order system. FIGURE 6 shows lightness, saturation and 
hue in a three dimension as described in "From Beginners to Professional Color 
EncYclopedia" (1993). A vertical axis represents lightness or intensity of colors, and the 
lightness is represented to be higher or brighter in a positive direction. The centrally 
5 located vertical axis represents an achromatic axis or a zero saturation point in the three 
dimensional representation. Saturation of colors is thus represented by a horizon axis that 
is perpendicular to the lightness axis. As being away from the achromatic axis, the 
saturation of a give color becomes higher. Lastly, with respect to a given point on the 
circumference of the three dimensional body, color or hue of colors is represented. 

0 

FIGURE 7 illustrates sections of the Munsell color-order system that are sliced 
perpendicularly to the achromatic axis as described in "Interesting Color Story" published 
by Japanese Industrial Newspaper (1991). 



15 FIGURE 8 is a diagram illustrating a method of selecting a font color based upon 

the background color according to the current invention. The Munsell color-order system 
is illustrated as a sphere for simplification and includes an achromatic axis 50 and a zero 
saturation point N on the achromatic axis 50. The point N is also at a mid point of the 
lightness range 0 through 10 at the lightness level of 5. When an arbitrary point A in the 

2 0 Munsell color-order system is selected as a background color based upon a color expert, 
and an optimal color is selected for the background color within a range E or with in a 
predetermined range from a point B. A relative distance "a" is defined as a distance 
between the point A and the point N while a relative distance "b" is defined as a distance 
between the point B and the point N. The point B is selected so that an inter-point line AB 

2 5 perpendicularly intersects the achromatic axis at the point N. The point B is also selected 

at a point where the a to b ratio is equal to or over 4 to 1 . That is, if the relative distance b 
between the mid point N and the point B is set to 1 , the distance a between the point N and 
the point A is equal to or over 4, Furthermore, the angle co between range limiting lines 
with respect to the perpendicularly intersecting line AB is 15° at the point A to form a 

3 0 circular area at the point B on a plane that is perpendicular to the line AB for representing a 

range E where an optimal color is selected. The 15 -degree angle means a range that covers 
three colors including the adjacent two colors and the color itself and the range also means 



12 



RCOH-1036/AP01-250 PATENT 

the same color for human perception. 

Referring to FIGURES 9 and 10, a method of determining the point B and the 
range E for the angle co at the point B will be described. FIGURE 9 shows that the center 
of the Munsell color-order system representation is used as an origin in the three 
dimensional coordinate, and the mid point N is on the origin (X=0, Y=0, Z=0). The point 
A is (XO, YO, ZO) while the point B is (XI, Yl, Zl) as shown in FIGURE 9. Since the 
point N is at the origin of the three dimensional coordinate, the line AN has the length and 

-YO 
-ZO 



the vector AN. That is, the vector AN= 



. If the line AN: the line BN^4: 1 , since the 



10 point B is at 5/4 of the vector AN, the point B (XI, Yl, Zl) has X1--5X0/4, Yl=-5Y0/4, 
Zl=-5Z0/4. The line AB and the X axis, the Y axis as well as the Z axis respectively form 
an angle a, an angle P and an angle y. Based upon the textbook geometry, X=cos a, [ir^cos 
p, v=cos y. If the line AB has the length R, cos a=(Xl-X0)/R, cos p-=(Yl-Y0)/R, cos 
y-(Zl-ZO)/R. Based on the above relationships, Xl-XO=XR, Yl-YO-^R, Zl-ZO-vR are 

15 obtained, since (Xl-XO)^ + (Yl-YO)^ +(Z1-Z0)^ - R\ The plane including the range E 
from the point B is expressed by the following equation (1) : 



}^X+^U+vZ= ^j{(Xl - XOf + (Yl - YOf + (Zl - ZO)'} (1) . 

The predetermined range E is on the plane as expressed by the equation (1) and is with in a 
radius r from the point B and the plane is limited by (o=\5 . From the equation (1), 



20 tan (co/2)=r/ ^^J{(Xl - XOf + (71 - 70)' + (Zl - ZO)' } ...,(2). 

From the equation (2), the radius r is determined based upon the coordinate of the point A 
(XO, YO, Zl). Within the range E, colors are specified by coordinates (X, Y, Z) within the 
radius r from the point B, and these colors are candidates for the font or pen color. 
Subsequently, the three dimensional coordinate data is connected into the color value and 
2 5 then to the RGB color data by referring to the conversion tables that are stored in the hard 
disk as described above. 

Referring to FIGURE 10, a flow chart illustrates the steps involved in a preferred 
process of determining the font color according to the current invention. In a step S3a, a 
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plane containing a range E with from the point A at the point B as the center is 

derived from the equation (1). The radius r is derived from the equation (2) in a step S3b, 
and the color at the coordinate (X, Y, Z) is determined in a step S3c w^ithin the radius r 
from the point B based upon the predetermined mapping tables. According to appropriate 
5 perception based upon color experts' experience, when the background color at the image 
display position is represented on the line between the point A and the mid point N in the 
Munsell color-order system, a color is selected for display within a range of colors from 
the point B that is positioned at a 14 location with respect to the mid point N in comparison 
to that of the point A in the Munsell color-order system. By the above method, a display 
10 color is best selected without human intervention for easy viewing and optimizing the 
identification of the display image. Although the font or pen color is automatically 
selected against the background color as described above, the selected font color is 
^^3 optionally modified by the character icon 49a. 

15 When characters or graphics are superimposed on animation or still image as a 

J™ background, the most commonly used color in the entire image is treated as its background 

color and the above described process is performed. The characteristic color of the image 
12 is checked based upon the RGB data that has been inputted in the animation/still video 

f/i memory 46. For example, a color of each pixel is grouped into a predetermined number of 

2 0 similar representative colors based upon similarity, and the most predominant 

representative color is considered as a background color in order to select an optimal font 
color. Using the above described font color determination method, words for a song to be 
superimposed on the image are easily seen in a display color in a karaoke device. 

The above described operation is not limited to windows such as a presentation 

2 5 material generation window but is applicable to any display screen. Similarly, the above 

described method is not limited to characters but is automatically applicable to other 
display images such as straight lines and rectangular lines. In the alternative, the above 
described operation is performed by having a personal computer read and execute a 
program that is stored in a FD or DVD-RAM. For example, as shown in FIGURE 2, a 

3 0 computer includes a memory such as ROM 1 4, FD, DVD-RAM so that a computer 

program is executed. In particular, an application program includes a control program to 
execute a variety of operations with respect to a recognition means, a calculation means, 
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and a display color determination means as described in the preferred embodiment. The 
control programs are stored in storage unit such as DVD-RAM and are previously installed 
in ROM 14 or a hard disk 17. Upon boot strapping, a copy of the control program is 
copied and is read by the CPU 10. Since the CPU 10 reads a variety of programs and 
5 executes a corresponding process, a personal computer 1 implements the preferred 
embodiment of the color display control device and process according to the current 
invention. 

Referring to FIGURE 1 1, a diagram illustrates a second preferred embodiment of 
10 the color font display optimization system according to the current inventions. Since the 
same reference numerals refer to the substantially same components of the first preferred 
embodiment, the description will be abbreviated for the second preferred embodiment. 
When an arbitrary point A in the Munsell color-order system is selected as a background 
color based upon a color expert, an optimal color is selected for a background within a 
15 range E from a point B which is located at a point where the b-to-a ratio is over 4 to 1 . The 
point A is determined so that the distance b between the point N and the point B is equal to 
or over 4. Furthermore, the range E is formed on a plane at the point B and is 
perpendicular to the line AB. The angle O) at the point B towards the point A is 15 degrees 
to limit the plane within the range E for selecting the color. The 15-degree angle 
2 0 limitations means a range that covers three colors including the two adjacent colors and the 
color itself, and the range also signifies the same color for human perception. That is, the 
point A and the point B are relative in their position. The second preferred embodiment 
has the opposite position of the point A and the point B. 

2 5 According to the appropriate perception of the color experts experience, when the 

background color at the image display position is represented at a point on the line between 
the point A and the mid point N in the Munsell color-order system, a color is selected for 
display with in a range of colors from the point A that is positioned at Va location with 
respect to the mid point N in comparison to that of the point A in the Munsell color-order 

3 0 system. By the above method, a display color is best selected without human intervention 

for easy viewing and optimizing the identification of the display range. 
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Referring to FIGURES 12 and 13, diagrams illustrate a third preferred embodiment 
of the color display optimizing system according to the current invention. The preferred 
embodiment calculates the position of the point B that is within a range E away from the 
point A by over four in the lightness directions that is selected as a background color in the 
5 Munsell color-order system. The line formed by the point A and the point B is parallel to 
an axis so indicative of achromatic. The range E formed on a plane at the point B and 
perpendicular to the line AB. The point B and the colors in the range E signify an optimal 
color against the background color. Furthermore, the range E is limited by an angle co=15'' 
formed at the point B towards the plane range^E and V^ co is set on with respect to the line 
10 AB on either side. The angle co means to include two adjacent colors and the color itself, 
that are perceived as a single color for human perception. 

For the background color for display characters that is the point A in the Munsell 
color-order system, the point B may not exist in the first or second preferred embodiments. 

15 In that case, however, as shown above with the third embodiment, a color is automatically 
selected as an appropriate display color with in a range of the perceptibly same color from 
the point B that is located over 4 or more in the lightness difference from the point A to 
provide sufficient distinction by a clear difference in lightness. That is, as described with 
respect to FIGURE 13, the lightness is shown in ten stages from the lightness 10 being 

2 0 completely white to the lightness 0 being completely black. When an image color and a 
background color have a difference of four in lightness, they appear to have sufficient 
visual distinction even if they have the same saturation and hue. 

Referring to FIGURES 14 and 15, diagrams illustrate a fourth preferred 

2 5 embodiment of the optimal image color selection system according to the current 

invention. The preferred embodiment calculates the position of the point B that is within a 
range E but is over 4 in lightness away from the point A that is selected as a background 
color in the Munsell color-order system. The line formed by the point A and the point B is 
perpendicular to an achromatic axis 50. The range E is limited by an angle co=l 5"* formed 

3 0 at the point B towards the plane range E, and I/2 co set on with respect to the line AB on 

either side of the line AB on either side of the line AB. The angel co=15*' means to include 
two adjacent colors and the color itself that are perceived as a single color for human 
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perception. Although the point B may not exist as shown in the first and second preferred 
embodiments, depending upon the point A in the Mussel color system, an appropriate 
image display color is automatically selected to distinguish on the saturation difference for 
clear visual display. When the point A exists on the achromatic axis 50, the appropriate 
5 display color is selected from the range E within the difference of 4 in saturation from the 
point B which forms a line AB that is perpendicular to the achromatic axis 50. Referring 
specifically to FIGURE 15, the point A exists on the achromatic axis 50, and the above 
described criteria are still applicable. 

Now referring to FIGURES 16 and 17, a diagram and a flow chart illustrate a fifth 
10 preferred embodiment of the optimal image color selection system according to the current 
invention. The fifth preferred embodiment is essentially identical to the first and second 
embodiments except for excluding a process to select a display color based upon the point 
■^^ B when the points A and B belong to a predetermined combination of colors. That is, for 

M example, a certain set of colors such as shades of pink is not appropriate in the image .or 

15 background colors for business presentations using a color display 2. The predetermined 

colors or certain combinations of predetermined colors are excluded from the color display, 
g Referring particularly to FIGURE 16, a shaded range indicates a predetermined 

2; combination of colors such as 5RR (red-purple), -lO(green), 5R (red), -5G, lOP(purple) 

yj and -1 OGY (green yellow) in the Mussel color chart. This color range is excluded from 

"LZ 2 0 the first and second preferred embodiments. In the fifth preferred embodiment, the process 
M as described in the third and fourth preferred embodiments is preformed to select an image 

. or display color. 

FIGURE 17 illustrates steps involved in the preferred process of the image display 

2 5 color selection. In a step S 1 1 , after a point A as a background color is identified in the 

Munsell color-order system, it is determine whether or not a point B exists with respect to 
the point A in such a way that a:b=4: 1 or over in the Munsell color-order system as 
described with respect to the first preferred embodiment. Altematively, it is determined 
whether or not the point B exists with respect to the point A in such a way that a:b=l :4 or 

3 0 over in the Munsell color-order system as described with respect to the second preferred 

embodiment. When the above point B exists, it is determined in a step S 12 whether or not 
the relationship between the colors indicated by the points A and B is one of the 
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predetermine color combinations as shown in FIGURE 16. The decision is either a step or 
a device that performs the same function. One implementation of the step is to refer to a 
table of the predetermined undesirable color combinations that is stored in the hard disk 17 
in order to make the above determination. An image display color is selected based upon 
5 the point B. If the points A and B fail to represent one of the predetermined prohibited 

color combinations is a step S13. On the other hand, if the points A and B represent one of 
the predetermined prohibited color combinations, it is determined in a step S14 whether or 
not the point B exists at a point that is perpendicular to the point A and represents a four 
degree of difference in saturation from the point A as described with respect to the third 

10 preferred embodiment. If the point B exists in the step S 14 and neither the point A or B is 
on the achromatic axis 50 in a step SI 5, an image display color is selected based upon the 
point b in step S13. On the other had, the above described point B does not exist in the 
step S 14 or the point B is on the achromatic axis 50 in the step S 1 5, an image display color 
is selected based upon the point B in the step B after the point B is calculated to have a 

15 saturation degree of four in the step SI 6. In the preferred process, it is also optionally 
selectable to have a fantasy mode in which the above described color exclusions are not 
performed. For example, even if a color combination is a predetermined undesirable color 
pair, when the fantasy mode is specified via a keyboard in a step SI 7, an image display 
color is selected as described with respect to the first and second preferred embodiments. 

2 0 The above fantasy mode is optionally used with a business mode in which a predetermined 
set of color combinations is prohibited. 

Now referring to FIGURES 18 and 20, a diagram and a flow chart respectively 
illustrate a sixth preferred embodiment of the image color display selection according to 

2 5 the current invention. Referring to FIGURE 19, one exemplary implementation is a color 

display devices 61 and includes a display panel 62a for displaying characters and images, a 
tablet 63 for receiving an input signal and an input pen 64 for writing on the tablet 63 as a 
pointing device. The tablet 63 further includes two layers of parallel electrode 63x and 63 
y, and the electrically contacted area position is detected upon the pressure from the pen 

3 0 64. The tablet 63 receives the pressured location of the pen 64 on the color display unit 62 

and detects the coordinate via the coordinate detection unit 66. The color display unit 6 
displays the trace corresponding to the coordinates detected through the tablet 63. A 
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control unit 65 of the color display device 61 further includes the coordinate detection unit 
66, a frame memory unit 67, a background color identification unit 68, a writing color 
generation unit 69, a writing color storage unit 70 and an image output control unit 71. 
That is, the above exemplary implementation illustrates an application to the color display 
5 device which incorporates the color display unit 61 and the color display control unit 65, 
thus, the writing color and the display color are the same. The coordinate detection unit 66 
continually detects the position of the pen 64 based upon the output signal from the 
transparent electric terminal 63x, 63y in the tablet 63. The tablet 63 and the coordinates 
detection unit 66 together implement the coordinate input/detection function. The frame 
10 memory 67 stores display information on the coordinate data and the background color. 
The color background identification unit 68 continuously identifies a background color at 
the point A in the Munssell color system at the writing coordinate based upon the 
information in the frame memory unit 67. 

15 The writing color generation unit 69 continuously calculates a writing color for 

displaying the color writing trace based upon the point 68. The writing color memory 
■ storage unit 70 stores a writing display color that has been automatically generated by the 
writing color generation unit 69. The writing color generation unit 69 and the writing color 
memory storage unit 70 perform the automatic writing color selection function. The image 

2 0 output control unit 7 1 reads the coordinate date from the frame memory 67 and displays 

the inputted trace in an automatically selected pen color on the display panel 62a of the 
display means 62. 

FIGURE 20 is a flow chart illustrating steps that are performed by the color display 
25 device 61 . After characters and diagrams are inputted by contacting the pen 64 on the 

tablet 63, the coordinate detection unit 66 continuously detects the pen coordinate position 
of the pen 64 in a step S21, and the detected coordinate data is stored in the frame memory 
67 in a step S22. The background color identification unit 68 reads the background color 
at the coordinates stored in the frame memory 67 and identifies a corresponding point A in 

3 0 the Munssel color system for each coordinate in a step S23. An optimal pen color is 

determined based upon the point A according to a predetermined calculation method and is 
stored in the pen color memory unit 70 in a step S24. It is then detected if the background 
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color changes in a step S25. If the background color changes in the step S25, then the 
steps S23 and S24 are repeated in order to select another pen color that corresponds to the 
changed background color. On the other hand, if the background color does not change in 
the step 825, the optimal color stored in the pen color memory unit 70 is placed at a 
5 portion corresponding to the coordinate in the frame memory 67 in a step S26. The image 
output control unit 71 reads the coordinate data from the frame memory 67 and displays 
the input pen trance at each of the coordinates in the specified pen color in the display 
panel 62a. As described above, since the pen 64 is automatically selected for a background 
color at each of the pen coordinates and the color pen trace is displayed in the color display 
10 device 62, the inputted characters and diagrams are clearly identified. 

C3 The pen color is calculated based upon the Munssell color-order system that 

, expresses intensity, saturation and hue in a three dimensional representation as shown in 

FIGURE 6 and as also disclosed in "Color Encyclopedia From Beginners to Professionals" 
jz 15 (1993). The three dimensional representation is sliced and perpendicularly placed with an 

achromatic axis as shown in FIGURE 7 and also disclosed in "Interesting Color Story" 

Nikkan Kogyo Shimbun, Sept 26 ( 1 99 1 ). 

y4 FIGURE 8 is a diagram illustrating a method of selecting an optimal pen color that 

f 1 2 0 corresponds to the background color, using the Munsell color-order system. The Munsell 

color-order system is represented by a simplified sphere where a mid point N represents < 
zero saturation and intensity 5 on an achromatic axis 50. Based upon the exert experience, 
when a point A is arbitrarily selected as a background color in the Munsell color-order 
system, a point B is determined at a such position so that the ratio of distance a : b is over 4 

2 5 : 1. A first distance "a" represents a distance between the point N and the point A while a 

second distance "b" represents a distance between the point N and the point B. An optimal 
color is selected from a predetermined range E within the point B for a background color. 
In other words, supposing the distance "b" is 1, the point B is selected so that the distance 
"a" is equal to or larger than 4. Furthermore, an optimal color is selected from the range E, 

3 0 which is a plane that is limited by an angle (0=15° and signifies a scope of perceptibly 

single color including the color itself and two adjacent colors. Based upon the exert 
experience, when a point A is arbitrarily selected as a background color in the Munsell 
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color-order system, by selecting a point B at a such position so that the ratio of distance a : 
b is equal to or over 4 : 1 and using an optimal color within a range E from the selected 
point B, the visual identification of a superimposed image by the pen 64 is automatically 
optimized over the use of a simple supplemental color. 

5 

Now referring to FIGURE 1 1 , a diagram illustrates a seventh preferred 
embodiment of the image color display selection according to the current invention. Based 
upon the expert experience, when a point A is arbitrarily selected as a background color in 
the Munsell color-order system, a point B is determined at a such position so that the ratio 
10 of distance a : b is equal to or over 1 : 4. A first distance "a" represents a distance between 
the point N and the point A while a second distance "b" represents a distance between the 
£3 point N and the point B. An optimal color is selected from a predetermined range E within 

the point B for a background color. In other words, supposing the distance "a" is 1, the 
point B is selected so that the distance "b" is equal to or larger than 4. Furthermore, an 
j; 15 optimal color is selected from the range E, which is a plane that is limited by an angle co = 
%■ 1 5° and signifies a scope of perceptibly single colors including the color itself and two 

2 adjacent colors. Based upon the expert experience, when a point A is arbitrarily selected as 

f S a background color in the Munsell color-order system, by selecting a point B at a such 

lister 

W position so that the ratio of distance a : b is equal to or over 1 : 4 and using an optimal 

£3 2 0 color within a range E from the selected point B, the visual identification of a 

. superimposed image by the pen 64 is automatically optimized over the use of a simple 
complementary color. 

Now referring to FIGURES 12 and 13, diagrams illustrate an eighth preferred 
25 embodiment of the image color display selection according to the current invention. Based 
upon the expert experience, when a point A is arbitrarily selected as a background color in 
the Munsell color-order system, a point B is determined at a such position so that a line AB 
is parallel to the achromatic axis 50 and the point B and the point A have a difference of at 
least four in lightness. An optimal color is selected from a predetermined range E within 
3 0 the point B for a background color. Furthermore, an optimal color is selected from the 
range E, which is a plane that is limited by an angle co = 15^ and signifies a scope of 
perceptibly single colors including the color itself and two adjacent colors. Based upon the 
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exert experience, when a point A is arbitrarily selected as a background color in the 
Munsell color-order system, by selecting a point B at the above described position and 
using an optimal color within a range E from the selected point B, the visual identification 
of a superimposed image by the pen 64 is automatically optimized over the use of a simple 
5 complementary color. Although the point B may not exist for the sixth or seventh 
preferred embodiment for certain positions of the point A in the Munsell color-order 
system, the point B is determined for an optimal pen color at a such position so that a line 
AB is parallel to the achromatic axis 50 and the point B and the point A have a difference 
of at least four in lightness as described above. Due to the sufficient difference in 
10 lightness, enough visual distinction for a pen color is automatically optimized. That is, as 
described with respect to FIGURE 13, the lightness is shown in ten stages from the 
C3 lightness 1 0 being completely white to the lightness 0 being completely black. When an 

J]5 image color and a background color have a difference of four in lightness, they appear to 

have sufficient visual distinction even if they have the same saturation and hue. 

JS ■ 

Now referring to FIGURES 14 and 15, diagrams illustrate a ninth preferred 
5 embodiment of the image color display selection according to the current invention. Based 

~ ~ upon the exert experience, when a point A is arbitrarily selected as a background color on 

Iw' the achromatic axis in Munsell color-order system, a point B is determined at a such 

H 2 0 position so that a line AB is perpendicular to the achromatic axis 50 and the point B and 

^""^ the point A have the same lightness but a saturation difference of four. An optimal color is 

selected from a predetermined range E within the point B for a background color. 
Furthermore, an optimal color is selected from the range E, which is a plane that is limited 
by an angle co = 15" and signifies a scope of perceptibly single colors including the color 

2 5 itself and two adjacent colors. Although the point B may not exist for the sixth or seventh 

preferred embodiment for certain positions of the point A in the Munsell color-order 
system, the point B is determined for an optimal pen color at a such position so that a line 
AB is parallel to the achromatic axis 50 and the point B and the point A have a difference 
of at least four in saturation as described above. Due to the sufficient difference in 

3 0 saturation, enough visual distinction for a pen color is automatically optimized. As shown 

in FIGURE 15, for a certain point A, the point B exists on the achromatic axis 50, and the 
above described optimal pen color selection is also applicable to this situation. 
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Now referring to FIGURES 16 and 21, diagrams illustrate a tenth preferred 
embodiment of the image color display selection according to the current invention. In * 
general, in the above described sixth and seventh embodiments, when the point A and the 
5 point B belong to a predetermined pair of prescribed color combinations as represented in 
Munsell color-order system, the pen color as specified by the point B is further processed. 
That is, assuming that any shade of pink color is prohibited for use in an official meeting, 
the color display device 61 excludes the pink pen color. As shown in FIGURE 16, a 
shaded range indicates a predetermined combination of colors such as 5RR (red-purple), - 
10 lO(green), 5R (red), -5G, lOP(purple) and -lOGY (green yellow) in the Mussel color chart. 
This color range is excluded form the first and second preferred embodiments. In the fifth 
preferred embodiment, the process as described in the eighth and ninth preferred 
embodiments is performed to select an image or display color. 

15 FIGURE 21 illustrates steps involved in the exemplary control process according to 

the current invention. In a step S3 1 , point A is selected in the Munsell color-order system 
as a background color. With respect to the point A, it is determined in a step S3 2 whether 
or not a point B exists in such a way that a : b is equal to or over 4 : 1 as in the case of the 
sixth preferred embodiment or a : b is equal to or over 1 : 4 as in the case of the seventh 

2 0 preferred embodiment. When the corresponding point B exists in the Munsell color 

system, it is further determined in a step S33 whether or not the points A and B are a 
prohibited color combination as shown in FIGURE 14. If the points A and B are not one 
of the prescribed color combinations, the process proceeds to a step S34 to select a pen 
color based upon the point B. On the other hand, when the points A and B are one of the 
25 prescribed color combinations, it is further determined in a step S38 whether or not the 
process in a predetermined fantasy mode. 

Still referring to FIGURE 21, if it is in the fantasy mode, the process proceeds to a 
step S34 to select a pen color based upon the point B. In other words, as shown in the sixth 

3 0 and seventh preferred embodiments, the pen color is selected based upon the point B by 

overruling the prescribed color combination. The fantasy mode is specified by a key or a 
button on an operational panel. When the conditions in the step S32 are not met, the 
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process proceeds to a step S35. Similarly, even though the conditions in the step S32 are 
met when the points A and B are in the prohibited color combination without the 
overruling fantasy mode, the process also proceeds to the step S35. In the step S35, it is 
further determined whether or not the point B exists at a location where there is a 
5 difference in lightness of at least 4 from the point A on a perpendicular line as described 
with respect to the eighth preferred embodiment. If the above specified point B fails to 
exist in the step S35, the process proceeds to a step S37, where the point B is determined at 
a location where there is a difference in saturation of at least 4 from the point A. On the 
other hand, if the above specified point B exists in the step S3 5, it is further determined in 
10 a step 36 whether or not the point A or the point B is on the achromatic axis 50. If neither 
of the points A and B is on the achromatic axis, the process proceeds to the step S34. If 
either of the points A and B is on the achromatic axis, the process proceeds to the step S37. 

1 5 Although the sixth or tenth preferred embodiment includes a coordinate input 

detection means such as a tablet 63 and a coordinate detection unit 66, the units are not 
necessarily limited to the above combination. For example, an optical coordinate detection 
means is applicable while the pen 64 itself fiarther optionally includes a coordinate 
detection function. A pointing device is not also limited to a pen and includes other 

2 0 devices such as a touch pad using a finger of an operator. Similarly, the color display 

means 62 is not limited to the disclosed embodiments and fiirther includes other types of 
color display means. 

Now referring to FIGURE 22, a chart indicates the evaluation of the pen display 

2 5 color that is automatically selected by the seventh preferred embodiment according to the 

current invention. The evaluation data is compiled from eight observers. As a sample 
observation color, a simple complementary color is used as a pen color against the 
background color, and the distance a + b between the points A and B is set to 6a, 5a, 4a and 
3a. As summarized in a table 1, the evaluation is made in a scale of one through five, five 

3 0 being the best. Against the five background colors (BG) A through E, a different pen color 

(PC) is evaluated, and the different pen colors include the simple complementary color 
(CC) as well as 6a, 5a, 4a and 3a colors. For each pen color, each observer evaluated the 
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visual distinction, and the number of observers who give more than three is also provided. 
Based upon the table 1, FIGURE 22 is a chart representing the percentage of observers 
who evaluated that a particular pen color is easy to read. 
Table : 1 
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OBSERVER 






BG 


PC 
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8 










CC 


5 


2 


1 


2 


3 


4 


3 


2 


4 
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1 
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3 
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1 
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3 
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2 
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2 



5 

As shown in FIGURE 22, approximately two thirds of the observers identified a 



pen color at the Point B to be easily recognizable if the pen color is above 4a while less 
than two thirds easily identified a pen color if the pen color is equal to or less than 4a. 

10 It is to be understood, however, that even though numerous characteristics and 

advantages of the present invention have been set forth in the foregoing description, 
together with details of the structure and function of the invention, the disclosure is 
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illustrative only, and that although changes may be made in detail, especially in matters of 
shape, size and arrangement of parts, as well as implementation in software, hardware, or a 
combination of both, the changes are within the principles of the invention to the full 
extent indicated by the broad general meaning of the terms in which the appended claims 
5 are expressed. 
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